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1. Introduction 

In the last decades there was a growing interest to the quantum effects of vacuum in 
curved space-time. In particular, there were investigations of the renormalization group 
flows for the parameters of the vacuum action in curved space-time: both perturbative and 
non-perturbative (see, e.g. the review || and further references therein). At present, the 
most of the non-perturbative results concern massless (mainly supersymmetric) models. In 
some cases, it was possible to establish the relation between the IR and UV /3-functions 
for the parameters of the higher-derivative sector of the vacuum action. 

An important application of the universal renormalization group flows in curved space 
is a candidate to be the natural model of inflation J^, |J], which is a modification of the well- 
known Starobinsky model || ^. The main advantage of the modified Starobinsky model 
of inflation is that it is based on the first principles of quantum field theory and does not 



- 1 - 



require conventional elements of the inflationary phenomenology such as inflaton, which 
do not have, at present, necessary particle physics justification. Moreover, this inflationary 
model does not require a special choice of the initial data and provides an automatic 
graceful exit to the FRW stage due to the supersymmetry breaking at low energies. The 
theoretical background of this approach to inflation consists of the quantum corrections 
to the classical action of vacuum |7|, ^] treated in the effective Quantum Field Theory 
framework. One of the key points is the decoupling of heavy degrees of freedom (similar to 
the standard Appelquist and Carazzone theorem in flat space ||) and especially sparticles. 
This decoupling results in the transition between the stable inflationary solution at the 
beginning and the automatic graceful exit to the FRW evolution at the end of the inflation 
epoch 0]. Qualitatively, the decoupling is a manifestation of the dominance of the mass 
terms in the quantum effects of the massive fields at low energies. In the gravitational 
case, the masses of the fields compete with the energies of the gravitational quanta at the 
external lines of the vacuum diagrams (see, e.g. [[l(J). Therefore, the quantitative study 
of the decoupling involves the analysis of the corresponding loop diagrams. Let us remark 
that, despite the decoupling theorem is well-known for the Quantum Field Theory in flat 
space-time (see, e.g. [If, 12 1), the study of this phenomena in curved space-time has been 
started just recently in Q. In this first paper we have investigated the massive scalar 
field non-minimally coupled to external gravity. The purpose of the present article is to 
generalize the results of ^ for the massive fermions and vectors, which are present in the 
low-energy spectrum in the electroweak (EW) and QCD sectors of the Standard Model of 
elementary particle physics (SM). Thus, we complete the description of the decoupling in 
the one-loop approximation. Furthermore, we shall discuss the decoupling of the sparticles 
in the supersymmetric theories beyond the SM. The present work should be considered as 
an important step to the future description of the behavior of the modified Starobinsky 
model in the interpolation regime between stable and unstable phases. 

One of the problems in the study of the low-energy vacuum quantum effects of the 
SM is the non-perturbative nature of the low-energy QCD. Despite the existence of the 
mentioned above non-perturbative exact renormalization group flows in the massless su- 
persymmetric version of QCD, they do not help too much in the realistic QCD theory 
which we are interested in here. As far as the non-perturbative results are not available 
for the phenomenologically relevant situations, we accept an effective field theory approach 
and describe the low-energy QCD using the Chiral Perturbation Theory model. It is well 
known, that all excitations of QCD at low energies are massive, and therefore their grav- 
itational effects should be suppressed due to the decoupling mechanism. We are going to 
construct a qualitative description of this phenomena using the effective approach. 

As we have seen in the previous work the calculations on the flat background 
(or equivalent covariant calculations performed through the expansion in the powers of 
the curvature tensor) can not be conclusive for the description of the decoupling of the 
cosmological constant and inverse Newton constant, which is unaccessible within the usual 
perturbative approach. Therefore, in this paper we will consider the /3-functions for the 
higher derivative terms in the effective action only. These terms are the most important 
ones for the inflationary model of EL hence they deserve serious attention. 
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The paper is organized as follows. In section 2 we present a qualitative description of 
the low-energy QCD and the corresponding effective models in curved space. In section 
3 the relation between the renormalization group for the massive fields and conformal 
anomaly for the corresponding massless fields is considered. Furthermore, we learn to 
make a distinction between various /3-functions in the vacuum sector. In section 4 we 
derive the relevant expressions for the effective action of massive scalars, fermions and 
vectors in curved space-time. In the case of scalars and fermions the massless limits fit 
with the anomaly-induced effective action, while for the Proca field an extra compensating 
scalar is needed. In section 5 we discuss the one- loop renormalization group flows for these 
fields. The identification of the /^-functions here is slightly different from the one in the 
previous paper (p). In section 6 consider an application of these results for the model with 
broken supersymmetry. Finally, in section 7 we draw our conclusions. 

2. Effective approach and the low-energy QCD in curved space 

Our general purpose is to investigate the renormalization group flow between the 
UV and IR regimes in the SM in curved space-time. The method for investigating the 
decoupling which was developed in ||] is essentially based on the perturbative approach and 
the practical calculations can be successfully realized only in the one loop approximation. 
In the EW sector this approximation is reliable, because here we meet weakly interacting 
fields in both UV and IR regimes. Indeed, many of these fields gain mass at low energies 
due to Spontaneous Symmetry Breaking and Higgs mechanism, but it is clear that the 
general approach of [0 does not meet big obstacles here and should be sufficient for getting 
the necessary information. 

Of course, the situation in the QCD sector of the SM is rather different. Due to 
the asymptotic freedom, in the UV regime the perturbative description works well and 
hence there is no difficulties with the use of the method of [jl]]. The real problem is the 
non-perturbative nature of QCD at low energies because, as we have just mentioned, our 
ability to make calculations in curved space-time is mainly restricted by the first order 
of the loop expansion. Hence, the first task is to understand which kind of information 
about the low-energy QCD in curved space one can obtain by making the perturbative 
calculations. 

As well known, the QCD Lagrangian in flat space-time reads 

L = -\F$F^ ^ + (#*7^ + igT a A a ^ k + m k ^ k ) , (2.1) 

k 

where F$ = d^A^—d^A^—gfa^A^Al is the field strength, T a are the SU C (3) generators, 
f a bc are the structure constants of the SU(3) algebra, and the summation is performed 
over the quark flavors. Due to the gauge symmetry the mass terms for gauge vector 
bosons are prohibited such that the gluons are massless at the Lagrangian level. Switching 
on the gravitational field, one may ask whether the gluons contribute to the running of 
the parameters of the gravitational action (|3.1| ) at low energies, including in the modern 
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Universe? 1 In what follows we argue that the answer to this question is definitely no. Let 
us remember that, below the nucleosynthesis scale, the magnitude of the Hubble parameter 
is much smaller than even the masses of the lightest neutrinos |l(J. Consequently, if we 
restrict our consideration to the semiclassical approach and therefore do not consider the 
quantum gravity effects, then only the photon and gluons may, in principle, contribute to 
the running. 

In order to study the QCD contribution to the vacuum gravitational renormalization 
group in the modern Universe, first of all we need to know how the QCD excitation spec- 
trum gets modified when we go from the high energy scale down to the very low energies. 
At high energies the QCD coupling constant is small and the perturbation theory based 
on the gluons and quarks is meaningful. Contrary to that, the low energy QCD, in terms 
of quarks and gluons is non-perturbative. At present, it is not possible to determine 

the low-energy QCD spectrum in a purely theoretical framework, starting from the first 
principles, and we need a certain phenomenological input here. Fortunately, the QCD 
excitation spectrum at low energies is known from experiment ]i~3|| . It is well known that 
there are no particles with the quantum numbers of gluons (needless to say that to explain 
theoretically the absence of gluons and quarks in the low energy QCD spectrum is a part of 
the confinement problem), and only composite particles like pions and kaons are observed. 
Perhaps, it is worth reminding that due to the unbroken Poincare symmetry all states in 
the low-energy QCD excitation spectrum are characterized by their mass and spin and as 
usual one interpret these states as particles. 

And so, what we really need is the effective spectrum of the low-energy QCD in terms 
of the composite particles. Presumably, the lightest states are the most important ones, 
because they should decouple from gravity at lower energies. According to the Particle Data 
Group [13 1, the lowest QCD excitations are the octet of pseudoscalar mesons: the pions 7r° 
(135 MeV) and tt* (139.6 MeV), the kaons if* (493.7 MeV), K° , and K° (497.7 MeV), 
and the rj-meson r/ (547.3 MeV). In massless QCD (when all bare quark masses are zero), 
these mesons would be massless since they are the Goldstone bosons connected with the 
Chiral Symmetry Breaking (therefore, these mesons are pseudoscalars) . The nine would 
be Goldstone boson rj acquires a nonzero mass due to the Ua{X) axial anomaly. Since 
chiral symmetry is explicitly broken in the real QCD, the pions, kaons, and the ?7-meson 
acquire nonzero masses. For example, the ir^ mass is given by 

2 m u + m d 
m n ± = 72 <uu> , 

Jit 

where m u and m<i are the u- and cf-quark masses, f w is the pion decay constant, and 
< uu > is the quark condensate. In addition to the pseudoscalar mesons, there are also 
some relatively light scalar in the QCD spectrum like /o (600 MeV) and ao (980 MeV), 
however, these scalar states are difficult to resolve because of their large decay widths. The 
vector particle with the lowest mass is the p meson. Although its mass p (771.1 MeV) 
is larger than pseudoscalars masses, the p meson plays a very important role in particles 
interactions of the low-energy QCD. Let us mention 



1 We thank Natan Berkovits for this question which motivated the discussion of this section. 
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here only the Vector Dominance and vector meson universality advocated by Sakurai 

0- 

The fermions with lowest masses in QCD are nucleons m p = 938.3 MeV and m n = 
939.6 MeV . Note that their masses are significantly larger than that of the pseudoscalar 
mesons. Let us remark that the decoupling is one of the key ideas of the Heavy Baryon 
Chiral Perturbation Theory, for it allows the perturbative study of the interaction of nu- 
cleons and pions despite the large value of the pion-nucleon coupling constant. Of course, 
this approach is possible only at low energies (for details, see, e.g., |]l5| ). 

According to the Chiral Perturbation Theory, the pions and kaons are the would be 
Goldstone bosons because the chiral symmetry is explicitly broken. Therefore, their in- 
teraction can be represented ||i~6| , |l7| l as a series in p 2 /16ir 2 f 2 (where p is a particle 
momentum), m 2 /167r 2 f 2 0.01, and m 2 ^ / 167T 2 f 2 0.18. It is convenient to collect the 
pseudoscalar fields in a unitary 3x3 matrix 

H -= 7T^ K 



U = exp(iV2$/U) , $ 



y/2 y/6 

*7T~ 



n ° + 4= K° 



\/2 V§ 



2r? 



and the effective Lagrangian of Chiral Perturbation Theory is then constructed as a series 
in derivatives of U and the pseudoscalars masses. For example, the leading-order term of 
the effective Lagrangian is given by 

L 2 = Y tT (^ + X^ + ^), (2-2) 

where the matrix x defines the pseudoscalars masses. The next-to-leading order effective 
Lagrangian contains terms with four derivatives, terms quadratic in derivatives and linear 
in X) and terms quadratic in x- 

Thus, for momenta less than 4k f n , the interaction of pions and kaons is weak and, 
consequently, it is a reasonably good approximation to consider one loop diagrams with free 
pions, kaons, and Ty-mesons in order to study the QCD contribution to the renormalization 
group running of the parameters of the vacuum gravitational action at low energies. Finally, 
since QCD does not have massless particles in its excitation spectrum and at energies less 
than m n o all QCD particles decouple, the QCD contribution to the renormalization group 
running of the gravitational action parameters is suppressed at low energies. In order to 
verify this, in a first approximation, it is sufficient to analyse the contributions of free 
massive scalars, spinors and vectors to the gravitational effective action at low energies. 



3. Renormalization group and conformal anomaly 

According to the previous section, the investigation of decoupling of the quantized 
massive fields from an external gravity may be reduced to the derivation of the effective 
action of vacuum for those fields: scalars, fermions, and vecctors. In the IR, we expect that 
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the mass terms will dominate and this leads to the low-energy decoupling. At high energies, 
we expect that the effects of the masses become negligible such that the effective action in 
the limit m — > coincides with the effective action derived for massless fields. In fact, 
this expectation is completely justified for the scalar and spinor fields and not justified at 
all for the massive vector. The reason is that the Proca field has larger number of physical 
degrees of freedom than the massless gauge vector field. This can be seen explicitly if 
one uses the Boulware transformation [18| for the massive vector or apply an equivalent 



one-loop procedure described in In both cases one can see that the Proca field has 
one extra scalar degree of freedom compared to the gauge boson. 

In the MS scheme, the metric-dependent vacuum divergences must be removed by 
adding appropriate local counterterms and renormalizing parameters 1/G, A, 01,2,3,4 of 
the classical action of vacuum 

S vac = Jd A x^g~{ -_l_(i? + 2A) + ai C 2 + a 2 E + a 3 nR + a 4 R 2 } , (3.1) 

Let us consider the massless conformal invariant fields in the one-loop approximation. In 
this case only the higher derivative conformal part of the vacuum action (including the 
surface and topological terms) 

Shdc = J d A x^=g~ [ ai C 2 + a 2 E + a 3 BR] , (3.2) 

is subject to renormalization. Shdc can be called "conformal", because it satisfies the 
Noether identity 

2 SShdc n ,0 o\ 

- -= — = . (3.3) 

On quantum level, the classical action of vacuum gains loop corrections and must be 
replaced by the corresponding effective action. Traditionally, the violation of the conformal 
identity ( |3.3| ) at quantum level is called the conformal anomaly of the Energy- Momentum 
(stress) tensor. This anomaly has the form (see, e.g. || and references therein) 

< T£ > = p^ 3 C 2 + #P E + #P UR 1 ( 3 - 4 ) 

where Pi^ s , (i^ S an d P 3 1S are the minimal subtraction (MS'-scheme) based /3-functions 
of the parameters 01,2,3 correspondingly (see e.g 

^ = -W?{^ No+ ^ Nl ' 2 -r N ^- (M) 
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Here Nq, an d N\ are the numbers of scalar, fermion, and vector massless fields, 

respectively. Let us remark that the /3-functions /?2 fS and [3^ IS result from the renormal- 
ization of the topological and surface terms in ( |3.lD . The corresponding divergences can 
be obtained explicitly using, for example, the Schwinger-DeWitt formalism (see, e.g. ||). 
However, in other calculational schemes, like the one which we shall apply below, topolog- 
ical and surface divergences are not seen explicitly. Therefore, these two /3-functions may 
be identified only through the analysis of the finite part of the effective action which is 



related to the anomaly (3.4). 

In the massive case, the higher-derivative divergences are exactly the same as for the 
massless fields. In the following sections we shall apply the physical mass-dependent scheme 
of renormalization and derive corresponding physical /3-functions which are generally dif- 
ferent from the ones of (3.5). In order to distinguish the two kinds of the renormalization 



group functions, we shall denote the MS-scheme /3-functions as [5 MS . The UV and IR 
limits of the /3-functions derived in the mass-dependent scheme will be denoted as f3 uv 
and (3 IR . Of course, we expect that the correctly defined /3-function would satisfy the 
relation 

(3 UV = /3(MS) + o(^- 

In this paper we shall consider /3i, (3% and (5^ , corresponding to the renormalization 
of the parameters a\ , £13 and 04 of the vacuum action (|3.1|) . The analysis of will 
not be presented here, because it requires much more involved calculation in the third 
order in curvature |20[| . Moreover, the decoupling in the /32-sector is less important for the 
application of the renormalization group and anomaly to inflation M. 

For the simple situation with the massless fields, the expression (3.4) enables one to 



derive, in an explicit and economic way, the effective action of gravity which is exact for 
the particular case of the homogeneous and isotropic FRW metric. The non-local covariant 



form of the anomaly-induced effective action is 22 



T md = S c [g, v ] + 3/V 3 + 6 2/V J d^xy^gjx) R 2 (x) 



J d^xyj-gix) j d i yy/-g{y) 



E OR 

3 



G(x,y) 



(E - -OR) 



(3..6) 



The conformal invariant functional S c [g^ u ] is an integration constant which can not be 
obtained using the conformal anomaly. The effective action fl3.6|) contains a Green function 
G(x, y) of the conformal differential fourth order scalar operator 



-RO 
3 



3 (V^)V M 



(3.7) 



The local term J d^x^—gR 2 in the first line of (|3.6| ) gains contributions from two /3- 
functions /S^ 5 and (3^f s . But, as we shall see in a moment, for our purposes only the 
^.f^-dependent contribution is relevant. As it was already mentioned, we are going to use 
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the massless effective action (|3.q ) in order to check the more general expression for the 
effective action of the massive fields in the UV limit. But, the calculations for the massive 
case will be performed only in the second order in curvature, so that in order to compare 
the two results we have to expand ( |3.6| ) up to the second order in curvature. In the situation 
of interest, this is equivalent to the bilinear expansion in the metric perturbation 

on the flat background pi. In both cases the operator ( |3.7| ) becomes just D 2 . The terms 
with C 2 and E in the second line of Eq. ( |3.6| ) can be safely neglected, for they are, at 
least, of the third order. Then, the remaining term in the second line of Q3.6j) is 



MS 
2 



18 



d 4 xy^gjxj J d A y^^y){UR) x [^^^ (UR) y . 



After some partial integrations, this terms precisely cancels with the /3^ 5 -dependent term 
in the first line of (|3.6j). Thus, the important consequence of our consideration is that, in 
order to perform verification of the second-order in curvature calculations for the massive 



case, we need to take only the /^^-dependent part of the J d 4 x^/—gR 2 -term in (3.6) 



V = — — — — / d 4 xJ=g~ ( — - — Nik + —Ni)r 2 , (3.8) 

Ps 12 (4vr) 2 J v y V 180 30 1/2 10 1 J ' v ' 



Also, as a by-product we can see whether the quantum correction ( |3.6[) contributes to 
the propagation of the gravitational waves in the flat space, e.g. in the modern Universe. 
Let us notice that the J ^J—gR 2 term does not contribute to the propagation of the 
transverse traceless (that is spin-2) mode. Therefore, the contribution to the equation for 
the gravitational wave on the flat background may come only from the conformal invariant 
functional S c but not from the anomaly- induced part. 

There is another aspect of the f d A x^—gR 2 -term, which is important for us. The 
anomaly-induced effective actions correspond to the massless conformal fields. However, 
there is an example of the field which is massless but not conformal: the scalar one with 
the non- minimal parameter £ ^ 1/6. In this case the parameter in the vacuum action 
( |3.1| ) has to be renormalized independently and there is a corresponding (3- function (3f IS . 
On the other hand, the DR-tevm in the conformal anomaly produces the finite J yJ—gR 2 - 
term in the effective action ([3.6]). For the massless case, these two i? 2 -terms do not mix, 
because the renormalization group is related to the divergent part of the effective action 
only. For the massive fields, in a physical mass-dependent scheme, the situation is quite 
different, because the /3-functions result from the finite part of the effective action. Then, 
the division of the J ^/— gi? 2 -term in the effective action between two /3-functions: (3^ for 
the parameter and (3^ for the 04 parameter in the action (|3.1| ) becomes ambiguous 
and one has to define the sharing in some appropriate way. 

In the previous work jjj we attributed all the f ^—gR 2 -term to the (3^. In the present 
paper we use another definition, which looks more natural. Since the infinite f ^J—gR 2 - 
type counterterm is absent for ^ = 1/6, we include all the terms proportional to (£—1/6) 
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into /?4-function. All other terms will be attributed to the (3%. Let us remark that this form 
of the sharing is the most useful for the cosmological application , because the existing 
version of the modified Starobinsky model is based on the supposition that £ ~ 1/6 . 
Another advantage of this definition is the following. We expect that in the massless 
limit the vacuum effective action of massive fields will converge to the anomaly-effective 
action. But, it is well known that the anomaly can be integrated only if the i? 2 -term in 
the anomalous trace is absent plL In turn, this requires the absence of the J ^J—gR 2 - 
counterterm, that can be achieved for the £ = 1/6 only. Hence, our way to identify the 
two /3-functions is natural in the sense it helps making the massless limit look simpler. 

4. The covariant derivation of the effective action up to the second order 
in curvature 



In this section we perform the derivation of the second order in curvature 0(R 2 )- 
terms in the one-loop effective action using the general expression for the heat kernel of 
the differential second order operator derived in [20, In the previous article Q we 



have demonstrated, using the massive scalar field as an example, that this covariant heat- 
kernel approach is completely equivalent to the calculation of the quantum correction to 
the graviton propagator from the matter loop (see also 1 24] for the similar calculation). 
Hence, our approach is analogous to the standard study of decoupling in QED J12| ] . 

We define the one-loop Euclidean effective action of a field with mass m as a trace of an 
integral of the heat kernel over the proper time s (compared to |^] there is an important 
exp[— m 2 s] insertion) 



f(i) 



1 



Tr In 



V 2 i + m 2 



b 



ds 



where K(s) is the heat kernel 



tr K(s) 



(Aits) 



d 4 x g 



1/2 e -sm* tr 



{ 



1 + sP + s z 



tr K(s) , 



R^h{sV 2 )R^ 



(4.1) 



+Rf 2 (sV 2 )R + Ph(-sX7 2 )R + Ph(-sV 2 )P + TZ^h(-sV 2 )il^ ] } + 0(H 3 ) , (4.2) 



where 1Z 



is a commutator of covariant derivatives in the space of the fields 



of interest. The functions /i,2,..,5(' r ) are given by the following expressions: 



Mr) - 
Mr) 



/(r)-l + r/6 



f(r) + f(r) 



12 



2r 



where 



f(r) 



Mr) = 
Mr) 

dae a{1 ~ a)T , 



f(r) /(r)-l /( r )-l + r/6 
288 

fir) 



24r 



Mr) 



8r 2 

1 ~ fir) 
2t 



-sV 2 



Below we consider how these formulas can be applied to the derivation of the effective 
action of scalars, fermions (in this case the overall sign in the Eq. ( [4.1|) has to be changed, 
of course), and vectors. 
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4.1 Massive scalar with the non-minimal coupling 

Let us first repeat the calculation for the scalar field performed in the previous paper Q. 
The main difference is that here we perform more detailed analysis of the massless UV 
limit for the non-conformal case £ 7^ 1/6. 

For the massive real scalar with the non-minimal coupling to gravity 

P = -(£ - 1/6)R and 7^ = • (4.3) 

Introducing the new variable sm 2 = t and notation u = r/t, we arrive at the following 
integral representation for the effective action: 



5 5 

+ J2 l * ■ R^MiBr + J2 l r RM i R \ ' ( 4 - 4 ) 

i=l j=l 



where 



^1,2 — 0) ^3 — 1 ) ^4 — g j ^5 — ~~ 1 : 



1 1 / 1\ 1 / 1\ 2 _ J_ _ 1 / 1 

1 ~~ 288 12 6/ + 2 V 6/ ' 2 ~ 24 2 V 6 



1 1 1 / 1\ 1 

8' /4 " 16 + 2v ? oV' 5 "8 



and 



M 1 = 4^, M 2 = IM, M 3 = 4^T, M 4 = J-, M 5 = * (4.5) 



As we shall see later on, the representation ( |4.4| ) exists also for the fermion and vector 
fields. The difference is just the values of the coefficients I* and lj. Hence, from practical 
point of view it is better to derive the integrals / °° dte~ l Mj(i, u) only once and later use 
them standard reference. 



Following Barvinsky and Vilkovisky [20|, we adopt the dimensional regularization in 



the form suggested by Brown and Cassidy |g5[ (see also for useful technical details). 
The UV limit r/sm 2 3> 1 and the IR limit t/sw? -C 1 can be easily investigated in this 
framework. The relevant integrals are 



rV~ 2 f°° dt MM ( m 2 y-2 [°° dt t l _ w f 1 (1 . 



(4vr) 



1 , / m 2 \ , 1 . 
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'777 



dt 



o (4tt)' 



w-2 r 00 ^ 



o (4vr)< 



./o 



(4vr 



1 , / m \ 3 1 / 1 
- +ln (iv) + 2 



2-w 



I 1 \ &4 



V2a 4 12a 2 160 J 15a 4 180a 2 400 vp 



+ 



+ 



(7) 



2x^-2 /■«) dt 



(An) 



Af 4 (t) 



/ »' 2 y 2 r 

Uvra 2 / 



(47T) 



u 



and 



(47T)" 



2-o> 



+ In 



/ m 2 \ 



+ 1 



1 1 



^ l (4^p bW ~ Vi^J 7 (4vr) 2 



2 ^-2 /•« ^ ! 



(4.9) 



where 
A = 



1 



(47T) 



1 1 / to 2 \ 3 

2(2 - w) + 2 n V4^V + 4 



1 1 \2 



da In 



1 + a(l — a)u 



a l-a/2 



and 



4V 2 



V 2 - 4m 2 



(4.10) 



(4.11) 



In the expressions (|4.6| ) - ( 4.10 ) we disregarded those terms which vanish in the u — * 2 
limit. Now one has to replace these integrals into Eq. ( |4.4| ) and use the relation |2C] 2 



R^XR^ - ^RXR = ^ C^ap X C^ al3 + 0(R 3 ) , 



(4.12) 



valid for any operator X build up from the powers of the covariant derivative. In this way, 
we arrive at the effective action for massive nonminimal scalar in the 0(R 2 ) approximation 



r 



a) 

scalar 



1 



2(47r) s 



771 



' + ln(^Uf 



L2-7i> 



771^ 



+ 



2 This relation holds only in the second order in curvature, and also means that we disregard the topo- 
logical Gauss-Bonnet term. In other words, it can be used if we are interested in the corrections to the 
gravitational propagator, but not to the vertex terms. 
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where 



+ R 



2 V s 6/ \2-w 



few (a) 



+ ln 



8A 2 1 

+ + 



15 a 4 45 a 2 150 
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(4.13) 



6 V ? 67 3a 2 V ? 6/ 9a 4 

1 7 



18a^ + 144 + 



+ 



108 a 2 



1 / 1 
21 GO + 18 V ~ 6 



(4.14) 



An important check of the expression ( |4,13j ) can be performed through the massless 
limit m — ► 0, where we expect to meet the 0(R 2 ) part of the anomaly-induced effective 
action ( |3.6| ). It is easy to see that the limit m — > is singular for the expression A in 
( 4.11 ). Fortunately, for £ = 1/6, the ^-dependent terms which contain this singularity 
cancel and we obtain 



rW(£ = l/6, m^0) 



12 • 180(4vr) 2 



d 4 x g 



1/2 R 2 



(4.15) 



This is exactly what we should expect due to ( p.8|) . Hence, the free scalar field with 
£ = 1/6 has consistent UV limit. But, let us remind that the nonminimal parameter £ 
can not be equal to 1/6 precisely within the interacting theory, because at higher loops 
such theory would be non-renormalizable |2(|. On the other hand, if we set £ ^ 1/6 and 
perform the massless limit, the overall (£ — 1/6) 2 f ^J—gR 2 term in the effective action has 



47r/i 2 /m 2 



term. The singularity 
> oo limit. Of course, 



regular behavior due to the cancelation with the In 

really appears not in the m 2 — > limit, but in the high-energy \p 
the coefficient of this divergence is identical to the pole l/(w — 2) coefficient. Hence, the 
singularity of the expression A in the m 2 — > or \p 2 \ — > oo limits is related to the UV 
divergence and must be treated by renormalization. Technically, this singularity shows the 
relation between the divergent and finite parts of the effective action in the UV. Similarly, 
in the massless limit a — > 2 there are terms proportional to A in the Weyl term formfactor 
kw(a). The UV singularities in kw(a) and fcfl(a) for £ ^ 1/6 mean the appearance of 
the covariant non-local terms like 



gC^p In -□/// )C I 



' fiwaf3 



and 



d 4 x 



0j R In - D/y #L16) 



These terms correspond to the renormalization group running, which we are going to discuss 
in section 5. 
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4.2 Massive fermion theory 

In this case the differential operator of interest is 

Hf = i( 7 ^V M + iuif) , (4.17) 

where rrif is a fermion mass. After the standard doubling procedure (see, e.g. M and also 

/] ) and using 



1 27J for a proof of the equality Tr In [7 M V^ + irrif] = Tr In [7 M V A 



the relations 



1 



and 



we arrive at the following coefficients in the massive fermion case: 

1 / --I / -1 • 1 

16 ' 3 ~ 8 ' 4 ~ 24 



<i = 0, z 2 



it! 



(4.18) 



ZJ = , l\ 



1 P 



i, « = -i 



'5 



(4.19) 



4 ' ° ' 4 12 

Of course, the sign of the whole expression (|4.2|) must be changed due to the fermion 
statistics of the field. After we established the coefficients (|4.18| ) and ( 4.19 ), the calculation 
reduces to the routine application of the equations ( |4.6| ) - ( |4.10| ) . The effective action has 
the form 



fermion 
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)+k f w (a)]c^ 



4(a) 



4(a) 



300,4a 2 - 480 A - 40a 2 + 19 a 4 
225 a 4 

a 4 - 120,4 - 10a 2 + 30Aa 2 



R 



(4.20) 



(4.21) 



270 a 4 

Of course, in the expressions for a and A from (4.11), one has to replace the scalar mass 
m by the fermion one mt. Let us remark that the i? 2 -type divergence in ( pT20| ) is absent, 
because the divergent term does not depend on the presence of a mass and because the 
massless theory is conformally invariant. 

Finally, in the massless limit rrif — » we obtain 

1 



m 



f 



0) 



12 • 30(4vr) 2 

in a perfect correspondence with the expected result ( |3.8j ) 



Jd^xg^R 2 + .... 



(4.22) 
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4.3 Massive vector theory 

The massive vector case (Proca theory) is the most complicated one, this especially con- 
cerns the correspondence with the anomaly-induced result (|3,8|) in the massless limit. Let 
us remark that this correspondence represents a very complete test of the calculations. 
The resulting J ^/— gi? 2 -term is sensible to the contributions from absolutely all higher 
derivative terms in the effective action for the massive theory. Those terms which do not 
contribute to (3.8) directly are verified through the cancelation of the singular A-structures 



or through the correspondence with the pole terms. 
The massive vector operator is 

H v = 5£U - V^V, -R£-62rr%, (4.23) 

and one can show that [19] 



Tr hiH v = Tr In - R% - 6% mf) - Tr In (□ - m^j + lnm 2 J d 4 x5£ £(0X4.24) 

where the first term is the non-degenerate massive vector operator and the second term is 
a scalar operator which is required to compensate an extra degree of freedom of the non- 
degenerate massive vector compared to the Eq. ( [4.23 ). Since the third term in (refvector 
oo) does not depend on curvature, we will omit it in what follows. 

As we have just mentioned, the efficient check of the calculations can be done by taking 
the massless limit and consequent comparison with the Eq. (|3.8j ). However, for the vector 
case the massless limit can not be simple 3 . In fact, we have to link the massless limit of 



the expression ( [4.24! ) with the similar, but different formula for the massless vector: 

TrlnH v (m v = Q) = Trlnf^D-^) - 2TrlnD. (4.25) 



In the massless case, the original theory is gauge invariant and the formula ( 4.25| ) results 



from the DeWitt-Faddeev-Popov procedure. The second term in the r.h.s. of the last 
equation represent the contribution of the Faddeev-Popov gauge ghosts. Of course, there 
are two scalar (ghost) degrees of greedom in the gauge field case 4 , in contrast to the single 
compensating scalar in the massive vector theory. Hence, the receipt of how to check the 
expression for the effective gravitational action of a massive vector field is the following. 
First, one has to derive the contribution of both non-degenerate vector and minimal scalar 
fields and then use ( 4.23| ). But, in order to have a correspondence with the conformal 



anomaly in the massless limit, the scalar contribution must be multiplied by the factor of 
two. 

Now we are in a position to perform the calculations. In the vector case 
*R>\w = ['R'ijvYp = —R a (3^v, P = P^ = q P ^ ~ P^ ■ 



3 For instance, this can be seen from the third term in (4.24). 

4 As far as we are interested in the vacuum gravitational effect, there is no difference between Abelian 
and non-Abelian theories. For the sake of simplicity, we shall consider the simplest Abelian version only. 
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After a simple algebra we obtain the following coefficients: 
h 



2' k 
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2 ' 12 
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'5 



-4. 



(4.26) 
(4.27) 
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/* _ o 7* — 4 7* — 

2 J l 2 — z i l 3 — 4 ' 4 g 

Using ( 4.26| ), ( |4.27 ) and the Eq. (4.4), we arrive at the effective action of a massive vector 
field 
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where 



91 2 8^.^ 8^4 
k w(°<) = -7^ + 7772-^2+^+^4' 
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kUa) 
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15a 2 3a 2 
,4 



1 



A 

2160 ' 48 + 3a 1 + 36a 2 18a 2 
Here, a and ^4 in Eq. ( 4.11| ) depend on the vector mass m v . The divergent part of ( 4.28] ) 
coincides with the expressions derived in [jOI. It is easy to see that the massless limit of 
the formfactor k v R {a) is singular, because the ^-dependent terms do not cancel. This is 
exactly what we should expect, because the consistent massless limit requires subtracting 
one more scalar contribution. In case of the double compensating scalar, instead of ( 4.2SQ , 
we meet the following formfactors in the higher derivative sector (here, index gv means 
"gauge-like vector") 

241 5A A 



5a 4 
A 



(4.29) 
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Using these formfactors, in the massless limit m v 
obtain 

1 



(4.30) 

we meet a non-singular result and 



m. 



0) 



+ 



d 4 xg^ 2 R 2 



(4.31) 



12 • 10(4vr) 2 

in a perfect correspondence with ( |3 . 8| ) . 

It is clear that the last result can not be interpreted such that we achieved a non- 
singular massless limit of the Proca field contribution to the effective action. But, in this 
way we checked both non-degenerate vector and compensating scalar contributions and 
thus ensured the correctness of our result flOp , ( |Ojj ). 
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5. Renormalization group equations 



The purpose of this section is to derive the renormalization group /3-functions for the 



parameters ai, a^, and 04 of the vacuum action (3.1) in the mass-dependent scheme. This 
calculation is relevant for the anomaly-induced inflation model of Q, because this model is 
based on the phenomena of the decoupling of the massive fields at low energies. Thus, we 
can not be completely satisfied by the standard mass-independent /^-functions which arise in 
the Minimal Subtraction (MS) scheme. In fact, the /3( MS ) -functions describe the running 
only at high energies, when they correspond to the leading logarithms in the vacuum 
effective action. The corresponding expressions |^8[ [2{| are the gravitational analogs of 
the generalized Euler-Heisenberg effective action in QED. An important advantage of the 
MS scheme is that the renormalization group can be formulated in a completely consistent 
nonperturbative covariant way [30, 31, 32, 

while the renormalization of the vacuum action in the mass-dependent scheme is not 
so general and has to involve the covariant expansion in the curvature tensor or (as we did 
in the previous paper Q) an expansion of the metric around the fixed (flat) background. 
However, in the high-energy UV limit the MS scheme and the mass-dependent scheme 
/3-functions must coincide and this enables one to check the envolved calculations in the 
mass-dependent scheme. 

In the MS scheme the /3-function of the effective charge C is defined as 

fjrj 

Pc(MS) = lim 11 — . (5.1) 

The derivation of the (3- functions for the parameters a\ , 03 , and 04 of the vacuum action 
( |3.1| ), in the mass-dependent scheme, has been described in ||] (see, e.g. |l2| for the 
general technical introduction to the effective approach in Quantum Field Theory). On 
flat background, one has to subtract the counterterm at the momentum p 2 = M 2 , where 
M is the renormalization point and calculate the /3-function using the formula 

dC 

Instead, one can simply take the derivative —pd/dp of the formfactors in the polarization 
operator. In the covariant formalism, we identify p 2 and — □ and rewrite the definition 
above using the variable a from the Eq. (4.11), therefore, the /3-functions are the opera- 



tors in the x-space. Now we can apply this procedure to the formfactors of the C 2 ua/3 and 
R 2 terms in the scalar, fermion, and vector cases. 

5.1 Massive scalar 

In this case the /3i-function has the form |l]] 

ft"*™' = ~ (4^2 ( 18^2 - 180 - -faT A ) ' ( 5 - 3 ) 

that is the general result for the one-loop (3- function valid at any scale. As one should 
expect, the /^-function for the Weyl term coefficient a\ does not depend on the nonminimal 
parameter £. 
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Figure 1 . The plots of the f3-functions (i) /3^ calar an d (ii) fi^ calar versus 
a. All the ^-functions in this and consequent plots are presented in the units 
of (4vr) 2 . 



As the special cases we meet the UV limit p 2 3> m 2 

1 1 ^(vr? 
h 01 — 

(4tt) 2 120 V p 



ft Calar ' UV = + (5.4) 



that agrees with the MS-scheme result (|3.5|) . In the IR limit p <C m we meet 

1 2 4 

R scalar,IR _ 1 P , ( P \ re r\ 

Pl ~ 1680 (4vr) 2 " ^2 + U {—4) ■ 

The last formula demonstrates the IR decoupling of the quantum effects of the massive 
scalar field. Moreover, the decoupling is a smooth monotone effect, that can be seen from 
the first plot (i) at the Figure 1. In this plot as in all similar plots in other figures, we 
use the variable a defined in ( f4.11| ). The advantage of the use of a is that this variable 
changes from a = in the IR to a = 2 in the UV, while p changes from p = to p = oo. 
It is important that the dependence a 2 = Ap 2 /(p 2 + 4m 2 ) on p 2 is also monotonic. 



Let us consider the remaining (3- functions and /?4. According to the definition 
given in section 3, /?4 is defined through the same procedure as (3\, if we separate the 
(£ — 1/6) -proportional terms in the formfactor kn(a) in Eq. ( [4.14 ), Direct calculations 
give the following expression (see also M) 
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In the UV limit p 2 S> m 2 the /3-function is (in agreement with the standard M S result 
131) 
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while in the IR limit p 2 <C m 2 we obtain 
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(5.8) 
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In order to define the /?3-function, according to the definition given in the section 3, one 
do not need to take derivative M d/dM. Instead, we can use the definition 

2 -a^-^r- =< r ;>< 



and the relation between the quantum-corrected trace and the /3-functions, which we gen- 
eralize from the massless case 5 . Thus, the required /?3-function can be defined directly 
from the — 1/6) -independent part of the formfactor kn(a) in Eq. ( [4.14 ): 

oscalar 1 r20-7a 2 (a 2 -4) 2 ii , . 



(Air) 



360 a 2 24 a 4 



The UV limit of this renormalization group function perfectly corresponds to the standard 
MS result (O) 



^scalar, UV 1 -~ / m 



« =-MW +0 ^)- <"»> 



while the IR limit demonstrates the decoupling of the scalar field 

jScalarJR 1 P 2 , ,*( P 4 



Finally (this is very important for the inflationary model of |||), the decoupling goes 
smoothly and is monotonic, as one can see from the second plot at the Figure 1. 

5.2 Massive fermion 

The /3-function of the a\ coefficient has the form 



The UV limit p 2 3> m 2 gives 



1 „/"m 2 



in agreement with the MS-scheme result and also with the expression for divergences in 
the effective action ( [4.20 ). The IR limit p 2 -C m 2 is qualitatively similar to the scalar case 
in the sense that it shows the decoupling 

afermion, IR 1 P /r\( V \ ir i a\ 

168 (47r) z m z \m*/ 

The plot demonstrating the smooth and monotone form of the decoupling for the (3\ is 
the first one (i) at the Figure 2. 



5 It is, of course, simpler to define the /33-function as a (£ — 1/6) -independent part of the _R 2 -sector of 
the effective action and do not mention the trace anomaly which plays only an illustrative role here. Our 
way of presentation is motivated by the will to maintain the link to the anomaly-induced effective action. 
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Figure 2. The plots of the (3-functions (i) ^f ermion anc [ (jj) p. 



of ermion 



versus a. 



According to our definition in section 3, the /?4-function is identically zero for the 
fermion field. The derivation of the /^-function performs similarly to the scalar case, but 
for the fermions we have to use the formfactor k^(a) from (4.21). The result is 



nj ermion 
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(5.15) 



The UV limit of this renormalization group function corresponds to the expected standard 
MS result Q 
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(5.16) 



while the IR limit demonstrates the decoupling of the spinor field 



fermion, IR 



4 + (4 



(5.17) 



420 (4vr) 2 

The second plot at the Figure 2 shows that the decoupling goes smoothly and is monotonic. 



5.3 Massive vector 

Despite the massless limit for the quantum vacuum corrections of the massive vector 
is singular (due to the gauge invariance and consequently different number of physical 
degrees of freedom), we can derive the general expressions for the /3-functions using the 
usual receipt. Then, the /3-function for the a\ coefficient is 
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(5.18) 



The UV limit p 2 S> m 2 demonstrates perfect correspondence with the divergent coef- 



ficient of the Weyl term in the effective action ( 4.2 
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(i) 



(ii) 





Figure 3. The plots of the (3 '-functions (i) 0\{a) and (ii) /54(a) for the 
case of the massive vector held. 



Of course, this corresponds, also, to the standard MS-scheme result [JHJ. Compared to the 
UV limit, exactly as in the scalar and fermion cases, the IR regime p 2 <C m 2 demonstrates 
the decoupling of the loop contribution 



vector, IR 



p2 + °(4 



112 (4vr) 2 m 2 

The decoupling occurs in a smooth manner, according to the first plot at the Figure 3. 



(5.20) 



In the R 2 - sector we meet a usual problem with the separation of the 0s an d 04 
functions. The problem is that, we can not use the same definition as for the scalar case, 
because in the vector case there is no parameter similar to £. At the same time, the 
presence of the J ^J—gR 2 divergence and the consequent UV singularity in the finite R 2 - 
term (of course, this only means that the non-local renormalization-group related term 



( 4.16 ) emerges) does not permit us to attribute all the R 2 - term in the effective action 
to /J3 . Hence, the explicit criterion for the separation is really absent. But, this does 
not indicate an inconsistency of the theory. Let us remind that the object of principal 
physical importance is the effective action ( 4.2S| ), which has no ambiguity beyond the 
usual renormalization point dependence. The separation of the two /^-functions means 
that we separate, in a certain manner, the finite and infinite R 2 -terms. Then, fixing the 
ambiguity in the /3-functions we define the certain framework for the well defined object 
such as effective action. 

After we apply the standard procedure, the expression for the 04 -function has the 
form 
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(5.21) 



In the UV limit we meet 
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in accordance with the corresponding divergence of the effective action ( |4.2Sj ), hence we 
agree with the MS'-scheme in this limit. In the IR limit the result is 

= -Tl2oW'S + (^)' < 5 ' 23 > 

that demonstrates the usual decoupling. The plot of the (3% -function is presented at Figure 
3. 

6. Decoupling in the case of supersymmetry 

According to the analysis of the previous section, the /3-functions show the standard IR 
behavior, that is the smooth and monotonic decoupling. It is interesting to see whether one 
can meet a similar feature of the /3-functions in case of decoupling of the super symmetric 
partners of the observable sector of the supersymmetric Standard Model (MSSM) or other 
supersymmetric gauge theory such as GUT. In the one-loop approximation, the /3-functions 
gain independent additive contributions from all the fields. We know that, for the energy 
scale below the mass of the particles, these /3-functions start to decrease and for p 2 <C m? 
the /3-functions are quadratically suppressed. Therefore, in order to investigate the details 
of the superpartners decoupling, we need to know the masses of all these superpartners. 
Unfortunately, this information is not available, and hence there is no chance to perform the 
detailed quantitative analysis of the decoupling. At the same time, it is possible to construct 
a very simple model which can illustrate the principal characteristics of supersymmetry 
decoupling. 

Let us consider, as an example, the minimal supersymmetric extension (MSSM) of the 
Standard Model (SM). The particle content of the SM includes 12 vectors (gluons, photon, 
W and Z vector bosons), quarks and leptons, which can be counted, in terms of the Dirac 
spinors, as N quar k = 18 and Ni epton = 6 (we suppose that the neutrino are Dirac massive 
particles, in case they are Maiorana particles this number gets changed Ni ept(m = 4.5, but 
all the conclusions remain the same), a complex Higgs doublet, which is equivalent to four 
real scalars. In total, using the notations of ( |3.5[) , we have 

N$ M = 4 , = 24 , N? M = 12 . (6.1) 

With this particle content we meet a positive overall sign of the induced f ^/—gR 2 -teim in 
fl3.Sj ). The same sign takes place in the present-day Universe, where only photon is active. 
And this sign has a very strong physical meaning. If we do not introduce large negative 
04 coefficient in the classical action ([O]), the positive sign in fl3.8|) means non-stability of 
the anomaly-induced inflation |Hj. On the contrary, if this sign is negative, the inflation is 
stable. Indeed, this happens in the MSSM, where 

N™ SSM = 104, N™£ SM = 32, N™ SSM = 12. (6.2) 

As it was suggested in the first reference of GJ, the decoupling of the sparticles may be 



responsible for the change of sign in (3.8), and this provides an appealing scheme of the 
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modified Starobinsky model of inflation which starts in the stable regime due to supersym- 
metry and has a natural graceful exit to the FRW evolution after supersymmetry breaks 
down. 

Our purpose is to obtain the qualitative description of the decoupling, without involv- 
ing the details of the supersymmetric spectrum. Therefore, let us assume the simplest 
possible input. Suppose that, for some reason, all the sparticles have masses much larger 
than the masses of the observed particles 6 . For the sake of simplicity, we suppose that 
all the constituents of the SM as massless. Moreover, we shall simplify things further and 
suppose that all the sparticles have exactly the same mass, which we denote M*. Hence, 
we arrive at the "super-simplified" model with the number of massless fields given by ( |6.1| ) 
and with the number of fields with an equal mass M* given by the difference with (|6.2|). 
An additional advantage of our simplifications is that one does not have massive vectors 
in this model and hence we are free from the corresponding problems with their massless 
limit which have been discussed in sections 4 and 5. 

At energies higher than the EW scale, the massless SM fields contribute as 
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where the parameter a depends on the mass M*. The overall (3- function for the parameter 
ai is given by the sum 



ft = (5f M + ft 
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The UV and IR limits of this expression are given by 
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respectively, and the plot of the /3-function is presented at the Figure 4. As usual, the 
decoupling is smooth and monotone. 



Figure 4. The plots of the /3-functions (i) 0i(a) and (ii) /33(a) for the 
case of the "super-simplified" supersymmetry breaking model. 

6 In some sense, this is a natural hypothesis. If there is no unknown general law of nature of this kind, 
it is very difficult to explain why the observed particles can not be superpartners of each other. Also, it is 
worth mentioning that this spectrum of supersymmetry leads to a natural inflation! 
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Figure 4. The plots of the (3 -functions (i) (3\{a) and (ii) ^(a) for the 
case of the "super-simplified" supersymmetry breaking model. 



The /^-function for the parameter 03 can be derived in the very same way as it was 
explained in section 5. The final expression has the following form: 
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It is easy to see that the sign of the /33-function changes from negative in the UV to positive 
in the IR, as we should (of course) expect. The /^-function dependence on the momenta 
is smooth and monotonic, as can be observed at the second plot at the Figure 4. We can 
see that the decoupling in the high derivative sectors goes in such a way that the transition 
between stable and unstable inflation performs in a smooth way. One can expect a 
qualitatively similar behavior of the /3-functions in realistic models of supersymmetry. 



7. Conclusions 

We have performed the calculations of the effective action of vacuum for the massive 
scalar, fermion, and vector fields to the second order in curvature, using a mass-dependent 
renormalization scheme. As a result, we have found the explicit form of the decoupling 
of the massive fields in the higher derivative sector of the vacuum effective action. In the 
high-energy limit there is a perfect correspondence between the /3-functions derived in a 
mass-dependent scheme and the standard ones derived within the MS-scheme. Also, in 
the same limit we have established the correspondence with the anomaly-induced effective 
action derived for the massless conformal fields. 

In the low-energy limit the /3-functions for the massive fields tend to zero in a smooth 
monotone way. For the supersymmetric model, the form of decoupling in the higher deriva- 
tive sector indicates the possibility of the soft transition between the stable and unstable 
regimes in the anomaly-induced inflation Q. In particular, we can observe explicitly, using 
the "super-simplified" (but reliable) supersymmetry breaking model, how the decoupling 
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of sparticles occurs. The detailed investigation of the cosmological applications will be 
reported separately. 
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